Image processing device for endoscope, endoscope device, image processing method of image processing device for endoscope, and image processing program

ABSTRACT

An image processing device for an endoscope outputs a video signal to an image display part that displays an observation image based on the video signal. The image display part is configured such that a first side of a display screen that displays the observation image is shorter than a second side intersecting with the first side, and is configured to be set in both a first setting state in which the first side is along a vertical direction and a second setting state in which the second side is along the vertical direction. The image processing device includes: a setting state recognition part configured to recognize the setting state; and a video signal generation part configured to generate the video signal such that the subject image in the observation image has an orientation corresponding to the setting state of the image display part.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application is a continuation of U.S. application Ser. No.15/710,207, filed Sep. 20, 2017, which claims priority to JP2016-198383, filed Oct. 6, 2016, the entire contents of each areincorporated herein by reference.

BACKGROUND

The present disclosure relates to an image processing device for anendoscope, an endoscope device, an image processing method of the imageprocessing device for an endoscope, and an image processing program.

In the related art of a medical field, there is known an endoscopedevice for imaging a subject such as the inside of a living body usingan imaging element to observe the subject (for example, refer toJapanese Laid-open Patent Publication No. 2004-000334 (FIG. 7)).

FIG. 12 is a diagram illustrating a configuration of an endoscope device100 in the related art. Specifically, FIG. 12 is a diagram illustratingan example of a layout of an operating room for performing an operationusing the endoscope device 100 in the related art.

As illustrated in FIG. 12 , the endoscope device 100 (medical device)disclosed in Japanese Laid-open Patent Publication No. 2004-000334 (FIG.7) includes: an endoscope 101 that is inserted into a subject SB tocapture a subject image; an imaging device 102 for an endoscope (camerahead) that is detachably connected to an eyepiece part of the endoscope101 and takes the subject image to generate a taken image; a controldevice 103 (video processor device) that processes the taken image takenby the imaging device 102 for an endoscope to generate a video signal;and a display device 104 (monitor device) that displays an observationimage based on the video signal processed by the control device 103.

FIG. 12 illustrates a situation in which an assistant D3 inserts theendoscope 101 into the subject SB lying down in a recumbent position ona bed BD through one side of his/her flank, and a surgical operator D1performs an operation on the subject SB using an electric scalpel device202 while observing an observation image displayed on the display device104.

As illustrated in FIG. 12 , a plurality of tool tables 201, the electricscalpel device 202, an anesthetic device 203, a peripheral device 204,and the like are arranged around the bed BD in addition to the controldevice 103 and the display device 104. The surgical operator D1, anassistant D2, the assistant D3, a nurse D4, and an anesthesiologist D5stand in a space around the bed BD avoiding the members 103, 104, and201 to 204 described above.

SUMMARY

In recent years, there is a trend to use the display device 104configured to have a large screen size of 40 inches or more for theendoscope device 100.

In a case in which the display device 104 configured to have a largescreen size is arranged, the width of the display device 104 isparticularly large, which obstructs a path of flow of a person standingin the vicinity of the display device 104 (in the example of FIG. 12 , apath of flow of the assistant D2 to leave the vicinity of the bed BD).

That is, the path of flow of the person may not be secured unless asetting place of the display device 104 and the like is changed. Afterthe path of flow of the person is secured, the display device 104 andthe like need to be moved back to an original setting place (in theexample of FIG. 12 , a place where the surgical operator D1 may easilyobserve the observation image).

Thus, there is a problem in that cumbersome work is required in movingthe setting place of the display device 104 and the like, andconvenience may not be improved.

An image processing device for an endoscope according to one aspect ofthe present disclosure may process a taken image including a subjectimage captured by an endoscope to generate a video signal, and outputthe video signal to an image display part that displays an observationimage based on the video signal, wherein the image display part isconfigured such that a first side of a display screen that displays theobservation image is shorter than a second side intersecting with thefirst side, and is configured to be set in both a first setting state inwhich the first side is along a vertical direction and a second settingstate in which the second side is along the vertical direction, and mayinclude: a setting state recognition part configured to recognizewhether the image display part is set in the first setting state or thesecond setting state; and a video signal generation part configured togenerate the video signal such that the subject image in the observationimage has an orientation corresponding to the setting state of the imagedisplay part.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram illustrating a schematic configuration of anendoscope device according to a first embodiment of the presentdisclosure;

FIG. 2 is a block diagram illustrating a configuration of the endoscopedevice;

FIG. 3A is a diagram illustrating a display device;

FIG. 3B is a diagram illustrating the display device;

FIG. 4 is a diagram for explaining a function of a subject imagediscriminating part;

FIG. 5A is a diagram for explaining a function of the subject imagediscriminating part;

FIG. 5B is a diagram for explaining a function of the subject imagediscriminating part;

FIG. 6 is a flowchart illustrating an operation of an image processingdevice for an endoscope;

FIG. 7A is a diagram illustrating an example of an observation imagethat is displayed on an image display part through an operation of theimage processing device for an endoscope when an inserting part is anendoscope having a small diameter;

FIG. 7B is a diagram illustrating an example of the observation imagethat is displayed on the image display part through an operation of theimage processing device for an endoscope when the inserting part is anendoscope having a small diameter;

FIG. 8A is a diagram illustrating an example of the observation imagethat is displayed on the image display part through an operation of theimage processing device for an endoscope when the inserting part is anendoscope having a large diameter;

FIG. 8B is a diagram illustrating an example of the observation imagethat is displayed on the image display part through an operation of theimage processing device for an endoscope when the inserting part is anendoscope having a large diameter;

FIG. 9 is a block diagram illustrating a configuration of an endoscopedevice according to a second embodiment of the present disclosure;

FIG. 10A is a diagram illustrating a modification of the first andsecond embodiments of the present disclosure;

FIG. 10B is a diagram illustrating a modification of the first andsecond embodiments of the present disclosure;

FIG. 11A is a diagram illustrating a modification of the first andsecond embodiments of the present disclosure;

FIG. 11B is a diagram illustrating a modification of the first andsecond embodiments of the present disclosure; and

FIG. 12 is a diagram illustrating a configuration of an endoscope devicein the related art.

DETAILED DESCRIPTION

The following describes modes for carrying out the present disclosure(hereinafter, referred to as embodiments) with reference to thedrawings. The present disclosure is not limited to the embodimentsdescribed below. The same component is denoted by the same referencenumeral throughout description about the drawings.

First Embodiment

Schematic Configuration of Endoscope Device

FIG. 1 is a diagram illustrating a schematic configuration of anendoscope device 1 according to a first embodiment of the presentdisclosure. FIG. 2 is a block diagram illustrating a configuration ofthe endoscope device 1. For convenience of explanation, FIG. 2 does notillustrate a light source device 3, a light guide 4, and a thirdtransmission cable 10.

The endoscope device 1 is a device used in a medical field for observinga subject such as the inside of a living body. As illustrated in FIG. 1or FIG. 2 , the endoscope device 1 includes an inserting part 2, thelight source device 3 (FIG. 1 ), the light guide 4 (FIG. 1 ), an imagingdevice 5 for an endoscope, a first transmission cable 6, a displaydevice 7, a second transmission cable 8, a control device 9, and a thirdtransmission cable 10 (FIG.

The inserting part 2 has a function as an endoscope according to thepresent disclosure. In the first embodiment, the inserting part 2 isconstituted of a rigid endoscope. That is, the inserting part 2 is rigidor at least part thereof is soft, has a long and narrow shape, and isinserted into the living body. In the inserting part 2, arranged is anoptical system configured by using one or a plurality of lenses forcondensing light of a subject image.

One end of the light guide 4 is connected to the light source device 3,and the light source device 3 supplies light for illuminating the insideof the living body to the one end of the light guide 4 under control bythe control device 9.

One end of the light guide 4 is detachably connected to the light sourcedevice 3, and the other end thereof is detachably connected to theinserting part 2. The light guide 4 transfers the light supplied fromthe light source device 3 from the one end to the other end to besupplied to the inserting part 2. The light supplied to the insertingpart 2 is emitted from a distal end of the inserting part 2, and appliedto the inside of the living body. The light applied to the inside of theliving body (subject image) is condensed by the optical system insidethe inserting part 2.

The imaging device 5 for an endoscope is detachably connected to a baseend (eyepiece part 21 (FIG. 1 )) of the inserting part 2. The imagingdevice 5 for an endoscope takes the subject image the light of which iscondensed by the inserting part 2 under control by the control device 9,and outputs an imaging signal (image signal) obtained by the imaging. Asillustrated in FIG. 2 , the imaging device 5 for an endoscope includes alens unit 51 and an imaging part 52.

The lens unit 51 forms, on an imaging surface of the imaging part 52,the subject image the light of which is condensed by the inserting part2. The lens unit 51 may be moved in an optical axis direction by adriving motor (not illustrated) arranged in the imaging device 5 for anendoscope to adjust a focal distance and a focus.

The imaging part 52 images the inside of the living body under controlby the control device 9. The imaging part 52 is configured by using asensor chip obtained by integrating an imaging element (not illustrated)with a signal processing part (not illustrated), and the like. Theimaging element such as a charge coupled device (CCD) or a complementarymetal oxide semiconductor (CMOS) receives the subject image the light ofwhich is condensed by the inserting part 2 and formed as the subjectimage by the lens unit 51, and converts the subject image into anelectric signal. The signal processing part performs signal processing(A/D conversion and the like) on the electric signal (analog signal)from the imaging element, and outputs the image signal. The imaging part52 outputs the image signal (digital signal) after A/D conversion. Thesignal processing part described above may be separately arrangedwithout being formed integrally with the imaging element.

One end of the first transmission cable 6 is detachably connected to thecontrol device 9 via a connector CN1 (FIG. 1 ), and the other endthereof is connected to the imaging device 5 for an endoscope via aconnector CN2 (FIG. 1 ). The first transmission cable 6 transmits theimage signal output from the imaging device 5 for an endoscope to thecontrol device 9, and transmits, to the imaging device 5 for anendoscope, a control signal, a synchronizing signal, a clock, electricpower, and the like output from the control device 9.

In the transmission of the image signal from the imaging device 5 for anendoscope to the control device 9 via the first transmission cable 6,the image signal may be transmitted as an optical signal, or may betransmitted as an electric signal. The same applies to transmission ofthe control signal, the synchronizing signal, and the clock from thecontrol device 9 to the imaging device 5 for an endoscope via the firsttransmission cable 6.

FIGS. 3A and 3B are diagrams illustrating the display device 7.

The display device 7 displays an observation image based on a videosignal processed by the control device 9. As illustrated in FIG. 2 ,FIG. 3A, or FIG. 3B, the display device 7 includes an image display part71, a support base 72 (FIG. 3A, FIG. 3B), and a state detection part 73(FIG. 2 ).

The image display part 71 is configured of a display using liquidcrystals, organic electro luminescence (EL), and the like, and displaysthe observation image on a display screen Sc (FIG. 3A, FIG. 3B). In thefirst embodiment, the display screen Sc is configured to have a screensize of 40 inches or more. An aspect ratio of the display screen Sc (aratio between a length dimension of a second side Sc2 (hereinafter,referred to as a long side Sc2) and a length dimension of a first sideSc1 (hereinafter, referred to as a short side Sc1)) is, for example,16:9.

The support base 72 is a portion for supporting the image display part71, and includes a pillar 721 and a plurality of leg parts 722 asillustrated in FIG. 3A or FIG. 3B.

The pillar 721 is configured of a pillar-shaped member along a verticaldirection, and an upper end thereof is connected to a substantiallycenter position of a back surface of the image display part 71. Thepillar 721 supports the image display part 71 in a rotatable manner.Specifically, the pillar 721 supports the image display part 71 so thatthe image display part 71 may be rotated (set) to be both in a firstsetting state in which the short side Sc1 of the display screen Sc isalong the vertical direction (FIG. 3A (hereinafter, referred to as ahorizontal arrangement state)), and in a second setting state in whichthe long side Sc2 is along the vertical direction (FIG. 3B (hereinafter,referred to as a vertical arrangement state)).

The setting state of the image display part 71 may be manually changed,or the setting state of the image display part 71 may be changed byarranging a motor, a foot switch, and the like so that the motor isdriven in accordance with an operation on the foot switch.

Each of the leg parts 722 is a portion that extends from a lower end ofthe pillar 721 in a direction substantially orthogonal to the pillar721, and comes into contact with a floor face.

The state detection part 73 detects the setting state (the horizontalarrangement state or the vertical arrangement state) of the imagedisplay part 71, and outputs a detection signal corresponding to thedetection result. Examples of the state detection part 73 include agravity sensor, an orientation sensor, an acceleration sensor, or anencoder and a rotation angle detection switch arranged at a connectingportion between the pillar 721 and the image display part 71.

One end of the second transmission cable 8 is detachably connected tothe display device 7, and the other end thereof is detachably connectedto the control device 9. The second transmission cable 8 transmits thevideo signal processed by the control device 9 to the display device 7,and transmits a detection signal related to the setting state (thehorizontal arrangement state or the vertical arrangement state) of theimage display part 71 to the control device 9.

The control device 9 includes a central processing unit (CPU) and thelike, and centrally controls operations of the light source device 3,the imaging device 5 for an endoscope, and the display device 7 via thefirst to third transmission cables 6, 8, and 10 in accordance with acomputer program (including an image processing program) recorded in amemory (not illustrated). As illustrated in FIG. 2 , the control device9 includes an image acquisition part 91 and an image processing device92 for an endoscope. That is, in the first embodiment, the imageprocessing device 92 for an endoscope according to the presentdisclosure is arranged in the control device 9.

The image acquisition part 91 causes the imaging device 5 for anendoscope (imaging part 52) to take the subject image, and acquires animage signal (taken image) from the imaging part 52. The imageacquisition part 91 then outputs the acquired taken image to the imageprocessing device 92 for an endoscope.

By performing predetermined processing on the taken image acquired fromthe imaging device 5 for an endoscope, the image processing device 92for an endoscope generates and outputs a video signal corresponding tothe setting state (the horizontal arrangement state or the verticalarrangement state) of the image display part 71.

Detailed configuration of the image processing device 92 for anendoscope will be described later.

One end of the third transmission cable 10 is detachably connected tothe light source device 3, and the other end thereof is detachablyconnected to the control device 9. The third transmission cable 10transmits a control signal from the control device 9 to the light sourcedevice 3.

Configuration of Image Processing Device for Endoscope

Next, the following describes a configuration of the image processingdevice 92 for an endoscope with reference to FIG. 2 .

As illustrated in FIG. 2 , the image processing device 92 for anendoscope includes a setting state recognition part 921, a subject imagediscriminating part 922, a magnification setting part 923, and a videosignal generation part 924.

The setting state recognition part 921 recognizes the setting state (thehorizontal arrangement state or the vertical arrangement state) of theimage display part 71 based on the detection signal input from thedisplay device 7 (state detection part 73) via the second transmissioncable 8.

FIGS. 4, 5A, and 5B are diagrams for explaining a function of thesubject image discriminating part 922. Specifically, FIG. 4 is a diagramillustrating an example of a taken image PF taken by the imaging part52. FIG. 5A is a diagram illustrating luminance distribution on ahorizontal line L1 in the taken image PF illustrated in FIG. 4 . FIG. 5Bis a diagram illustrating luminance distribution on a horizontal line L2in the taken image PF illustrated in FIG. 4 .

The subject image discriminating part 922 discriminates a subject imageSI (FIG. 4 ) in the taken image PF (for example, a position SIO (FIG. 4) and a size of the subject image SI) based on the taken image PF (FIG.4 ) acquired by the image acquisition part 91.

The subject image SI in the taken image PF taken by the imaging part 52has a substantially circular shape, as illustrated in FIG. 4 . Thus, thesubject image discriminating part 922 discriminates a diameter DM (FIG.4 ) of the subject image SI as the size of the subject image SI in thetaken image PF.

Specifically, as illustrated in FIG. 4 , the subject imagediscriminating part 922 detects luminance distribution on a plurality of(in the first embodiment, two) horizontal lines L1 and L2 in the takenimage PF. In the taken image PF, a region of the subject image SI isbrighter than the other region (in FIG. 4 , a hatched region (blankregion)). That is, as illustrated in FIG. 5A, regarding the luminancedistribution on the horizontal line L1, luminance is high between twointersection points SI1 and SI2 intersecting with a boundary of thesubject image SI, and the luminance is low in other portions. Similarly,regarding the luminance distribution on the horizontal line L2, asillustrated in FIG. 5B, the luminance is high between two intersectionpoints SI3 and SI4 intersecting with the boundary of the subject imageSI, and the luminance is low in other portions. Thus, by detecting theluminance distribution on the horizontal lines L1 and L2, the subjectimage discriminating part 922 may recognize the intersection points SI1to SI4 intersecting with the boundary of the subject image SI. Bycalculating a curvature center of the intersection points SI1 to SI4,the subject image discriminating part 922 discriminates (calculates) acenter position SIO of the subject image SI in the taken image PF. Bycalculating a distance between the center position SIO and any of theintersection points SI1 to SI4, the subject image discriminating part922 discriminates (calculates) the diameter DM of the subject image SIin the taken image PF.

The magnification setting part 923 sets magnification/reduction ratio ofthe subject image SI based on a recognition result obtained by thesetting state recognition part 921 and a discrimination result obtainedby the subject image discriminating part 922.

Specifically, when the image display part 71 is set in the horizontalarrangement state, the magnification setting part 923 sets themagnification/reduction ratio of the subject image SI to be a defaultvalue (for example, “1 (a value for not performing magnification orreduction)”). In a case in which the diameter DM of the subject image SIin the taken image PF is equal to or smaller than a threshold(hereinafter, referred to as a reference threshold) corresponding to thelength dimension of the short side Sc1 of the display screen Sc and theimage display part 71 is set in the vertical arrangement state, themagnification setting part 923 sets the magnification/reduction ratio ofthe subject image SI to be the same value (the default value (forexample, “1”)) as that in a case in which the image display part 71 isset in the horizontal arrangement state. On the other hand, in a case inwhich the diameter DM of the subject image SI in the taken image PF islarger than the reference threshold and the image display part 71 is setin the vertical arrangement state, the magnification setting part 923sets the magnification/reduction ratio of the subject image SI to be avalue smaller than the default value (for example, “ 9/16 (a valuecorresponding to the aspect ratio (16:9) of the taken image PF)”).

The video signal generation part 924 performs various pieces of imageprocessing on the taken image PF acquired by the image acquisition part91. Examples of the image processing include magnification/reductionadjustment, eccentricity correction, rotation correction, and positionmovement correction of the subject image SI in addition to known imageprocessing such as gain adjustment, white balance adjustment, gammacorrection, and contour emphasis correction.

The magnification/reduction adjustment of the subject image SI describedabove is performed as follows.

The video signal generation part 924 performs magnification/reductionadjustment on the subject image SI discriminated by the subject imagediscriminating part 922 based on the magnification/reduction ratio setby the magnification setting part 923.

The eccentricity correction of the subject image SI described above isperformed as follows.

The subject image, which is obtained when light is applied to the insideof the living body and reflected from the living body, is imaged by theimaging part 52 via an objective optical system (not illustrated)arranged at a distal end of the inserting part 2, an image transmissionoptical system (not illustrated) arranged in the inserting part 2 fortransmitting the subject image from the objective optical system to theeyepiece part 21, an eyepiece optical system (not illustrated) arrangedin the eyepiece part 21, and the lens unit 51. In this case, opticalaxes of the objective optical system, the image transmission opticalsystem, the eyepiece optical system, and the lens unit 51 deviate fromeach other, for example, the center position SIO of the subject image SImay deviate from (become eccentric to) a center position PFO of thetaken image PF as illustrated in FIG. 4 . In this way, when the subjectimage SI is eccentric, the subject image SI is also eccentric in thedisplay screen Sc (the center position SIO deviates from the centerposition of the display screen Sc).

The video signal generation part 924 performs processing (eccentricitycorrection of the subject image SI) of moving the subject image SIdiscriminated by the subject image discriminating part 922, and causingthe center position SIO of the subject image SI to be matched with thecenter position PFO of the taken image PF (matched with the centerposition of the display screen Sc).

The rotation correction of the subject image SI described above isperformed as follows.

When the image display part 71 is set in the horizontal arrangementstate or the vertical arrangement state, an up-and-down direction of thesubject image SI needs to be adjusted to be along a vertical directionin accordance with the setting state of the image display part 71.

When the setting state recognition part 921 recognizes that the imagedisplay part 71 is set in the vertical arrangement state, the videosignal generation part 924 performs processing (rotation correction ofthe subject image SI) of rotating the subject image SI discriminated bythe subject image discriminating part 922 by 90° so that an orientationof the subject image SI is caused to correspond to the verticalarrangement state of the image display part 71 (the up-and-downdirection of the subject image SI is caused to be along the verticaldirection).

The up-and-down direction of the subject image SI is set to be along thevertical direction (an extending direction of the short side Sc1)without performing the rotation correction described above when theimage display part 71 is set in the horizontal arrangement state. Thus,when the setting state recognition part 921 recognizes that the imagedisplay part 71 is set in the horizontal arrangement state, the videosignal generation part 924 does not perform rotation correction on thesubject image SI.

The position movement correction of the subject image SI described aboveis performed as follows.

When the setting state recognition part 921 recognizes that the imagedisplay part 71 is set in the vertical arrangement state, the videosignal generation part 924 performs the rotation correction describedabove, and performs processing (position movement correction of thesubject image SI) of positioning the subject image SI discriminated bythe subject image discriminating part 922 in a region corresponding toan upper region of the display screen Sc of the image display part 71set in the vertical arrangement state in the taken image PF after therotation correction.

The video signal generation part 924 then generates a video signalcorresponding to the taken image PF after the image processing describedabove, and outputs the video signal to the image display part 71 via thesecond transmission cable 8.

Operation of Image Processing Device for Endoscope

Next, the following describes an operation (image processing method) ofthe image processing device 92 for an endoscope described above.

FIG. 6 is a flowchart illustrating an operation of the image processingdevice 92 for an endoscope.

First, the image acquisition part 91 causes the imaging part 52 to takethe subject image SI, and acquires the taken image PF taken by theimaging part 52 (Step S1). The image acquisition part 91 then outputsthe acquired taken image PF to the subject image discriminating part 922and the video signal generation part 924.

Next, the subject image discriminating part 922 discriminates thesubject image SI in the taken image PF based on the taken image PFacquired by the image acquisition part 91 (Step S2). Accordingly, thecenter position SIO and the diameter DM of the subject image SI in thetaken image PF is discriminated (calculated).

Next, the video signal generation part 924 determines whether the centerposition SIO of the subject image SI deviates from the center positionPFO of the taken image PF (misregistration is present) (Step S3).

If it is determined that misregistration is present (Yes at Step S3),the video signal generation part 924 performs eccentricity correction onthe subject image SI in the taken image PF acquired by the imageacquisition part 91 (Step S4).

If it is determined that misregistration is not present (No at Step S3),or after Step S4, the setting state recognition part 921 recognizes thesetting state (the horizontal arrangement state or the verticalarrangement state) of the image display part 71 based on a detectionsignal input from the state detection part 73 via the secondtransmission cable 8 (Step S5: setting state recognition step).

Next, the setting state recognition part 921 determines whether theimage display part 71 is set in the horizontal arrangement state (StepS6).

If it is determined that the image display part 71 is set in thehorizontal arrangement state (Yes at Step S6), the magnification settingpart 923 sets the magnification/reduction ratio of the subject image SIto be a default value (for example, “1”) (Step S7).

After Step S7, the video signal generation part 924 performsmagnification/reduction adjustment on the subject image SI based on themagnification/reduction ratio set at Step S7 in the taken image PF onwhich eccentricity correction (Step S4) is performed or in the takenimage PF on which eccentricity correction is not performed (Step S8).After this, the process of the image processing device 92 for anendoscope proceeds to Step S15.

On the other hand, if it is determined that the image display part 71 isset in the vertical arrangement state (No at Step S6), the magnificationsetting part 923 determines whether the diameter DM of the subject imageSI in the taken image PF is larger than the reference threshold (StepS9).

If it is determined that the diameter DM of the subject image SI islarger than the reference threshold (Yes at Step S9), the magnificationsetting part 923 sets the magnification/reduction ratio of the subjectimage SI to be a smaller value than the default value (for example, “9/16”) (Step S10).

On the other hand, if it is determined that the diameter DM of thesubject image SI is equal to or smaller than the reference threshold (Noat Step S9), the magnification setting part 923 sets themagnification/reduction ratio of the subject image SI to be a defaultvalue (for example, “1”) (Step S11).

After Step S10 or S11, the video signal generation part 924 performsmagnification/reduction adjustment on the subject image SI based on themagnification/reduction ratio set at Step S10 or S11 in the taken imagePF on which eccentricity correction (Step S4) is performed, or in thetaken image PF on which eccentricity correction is not performed (StepS12).

After Step S12, the video signal generation part 924 performs rotationcorrection (Step S13) on the subject image SI, and performs positionmovement correction (Step S14) on the subject image SI in the takenimage PF after magnification/reduction adjustment (Step S12).

After Step S8 or S14, the video signal generation part 924 generates avideo signal corresponding to the taken image PF on which the imageprocessing described above is performed, and outputs the video signal tothe image display part 71 via the second transmission cable 8 (StepS15).

Steps S13 and S15 described above correspond to a video signalgeneration step according to the present disclosure.

Regarding various pieces of image processing performed by the videosignal generation part 924, timings for performing eccentricitycorrection (Step S4), magnification/reduction adjustment (Steps S8 andS12), rotation correction (Step S13), and position movement correction(Step S14) on the subject image SI are not limited to the timingsillustrated in FIG. 6 . The processing may be performed at a differenttiming. Other pieces of image processing (for example, gain adjustment,white balance adjustment, gamma correction, and contour emphasiscorrection) may be performed at any timing. That is, each of the otherpieces of image processing may be performed at a timing of Step S15, ormay be performed at a timing before Step S4.

Specific Example of Display Form

The following describes a specific example of the observation imagedisplayed on the image display part 71 through the operation of theimage processing device 92 for an endoscope described above.

The following sequentially describes a display form in a case in whichthe inserting part 2 is an endoscope having a small diameter, and adisplay form in a case in which the inserting part 2 is an endoscopehaving a large diameter.

Display Form in Case in which Inserting Part is Endoscope Having a SmallDiameter

FIGS. 7A and 7B are diagrams illustrating an example of an observationimage OF that is displayed on the image display part 71 through theoperation of the image processing device 92 for an endoscope when theinserting part 2 is an endoscope having a small diameter. In FIGS. 7Aand 7B, a character “A” is described in the subject image SI forconvenience to clarify the up-and-down direction of the subject imageSI.

When the inserting part 2 is an endoscope having a small diameter, thesubject image SI captured by the inserting part 2 has a small diameter(the diameter DM is equal to or smaller than the reference threshold (Noat Step S9)). Thus, the whole subject image SI is positioned within theimage region without extending off the image region of the taken imagePF.

If the image display part 71 is set in the horizontal arrangement state(Yes at Step S6), the video signal explained below is generated andoutput (Step S15).

That is, the video signal is obtained when the eccentricity correction(Step S4) is performed on the subject image SI in accordance with themisregistration (Yes at Step S3) of the subject image SI, and therotation correction (Step S13) is not performed on the subject image SI.

Thus, the observation image OF illustrated in FIG. 7A is displayed onthe image display part 71 set in the horizontal arrangement state basedon the video signal.

That is, in the observation image OF, the center position SIO of thesubject image SI is positioned at a center position ScO of the displayscreen Sc, and the whole subject image SI having a circular shape ispositioned within the display screen Sc. In the observation image OF,the subject image SI has an orientation such that the up-and-downdirection thereof is along the short side Sc1 (vertical direction).

On the other hand, if the image display part 71 is set in the verticalarrangement state (No at Step S6), the video signal explained below isgenerated and output (Step S15).

That is, the video signal is obtained when the eccentricity correction(Step S4) is performed on the subject image SI in accordance with themisregistration (Yes at Step S3) of the subject image SI, and therotation correction (Step S13) and the position movement correction(Step S14) are performed on the subject image SI. The video signal isobtained when the magnification/reduction adjustment (Step S12) isperformed on the subject image SI at the same magnification/reductionratio (default value (for example, “1”)) as that in a case in which theimage display part 71 is set in the horizontal arrangement state.

Thus, the observation image OF illustrated in FIG. 7B is displayed onthe image display part 71 set in the vertical arrangement state based onthe video signal.

That is, in the observation image OF, the whole subject image SI havinga circular shape is positioned within the display screen Sc, and thecenter position SIO of the subject image SI is positioned in an upperregion of the display screen Sc. In the observation image OF, thesubject image SI has an orientation such that the up-and-down directionthereof is along the long side Sc2 (vertical direction). In theobservation image OF, the size of the subject image SI is the same asthe size of the subject image SI in a case in which the image displaypart 71 is set in the horizontal arrangement state.

Display Form in Case in which Inserting Part is Endoscope Having LargeDiameter

FIGS. 8A and 8B are diagrams illustrating an example of the observationimage OF that is displayed on the image display part 71 through theoperation of the image processing device 92 for an endoscope when theinserting part 2 is an endoscope having a large diameter. In FIGS. 8Aand 8B, similarly to FIGS. 7A and 7B, the character “A” is described inthe subject image SI for convenience to clarify the up-and-downdirection of the subject image SI.

When the inserting part 2 is an endoscope having a large diameter, thesubject image SI captured by the inserting part 2 has a large diameter(the diameter DM is larger than the reference threshold (Yes at StepS9)). Thus, upper and lower portions of the circular subject image SIextend off the image region of the taken image PF.

If the image display part 71 is set in the horizontal arrangement state(Yes at Step S6), the video signal explained below is generated andoutput (Step S15).

That is, the video signal is obtained when the eccentricity correction(Step S4) is performed on the subject image SI in accordance with themisregistration (Yes at Step S3) of the subject image SI, and therotation correction (Step S13) is not performed on the subject image SI.

Thus, the observation image OF illustrated in FIG. 8A is displayed onthe image display part 71 set in the horizontal arrangement state basedon the video signal.

That is, in the observation image OF, the whole circular subject imageSI the upper and lower portions of which are cut is positioned withinthe display screen Sc, and the center position SIO of the subject imageSI is positioned at the center position ScO of the display screen Sc. Inthe observation image OF, the subject image SI has an orientation suchthat the up-and-down direction thereof is along the short side Sc1(vertical direction).

On the other hand, if the image display part 71 is set in the verticalarrangement state (No at Step S6), the video signal explained below isgenerated and output (Step S15).

That is, the video signal is obtained when the eccentricity correction(Step S4) is performed on the subject image SI in accordance with themisregistration (Yes at Step S3) of the subject image SI, and therotation correction (Step S13) and the position movement correction(Step S14) are performed on the subject image SI. The video signal isobtained when the magnification/reduction adjustment (Step S12) isperformed on the subject image SI at the magnification/reduction ratio(for example, “ 9/16”) smaller than that in a case in which the imagedisplay part 71 is set in the horizontal arrangement state.

Thus, the observation image OF illustrated in FIG. 8B is displayed onthe image display part 71 set in the vertical arrangement state based onthe video signal.

That is, in the observation image OF, the whole circular subject imageSI the upper and lower portions of which are cut is positioned withinthe display screen Sc, and the center position SIO of the subject imageSI is positioned in an upper region of the display screen Sc. In theobservation image OF, the subject image SI has an orientation such thatthe up-and-down direction thereof is along the long side Sc2 (verticaldirection). Additionally, in the observation image OF, the size of thesubject image SI is smaller than the size of the subject image SI in acase in which the image display part 71 is set in the horizontalarrangement state.

For example, at Step S10, when the magnification/reduction ratio of thesubject image SI is set to be the same as the magnification/reductionratio (a default value (for example, “1”)) in a case in which the imagedisplay part 71 is set in the horizontal arrangement state, the wholecircular subject image SI the upper and lower portions of which are cutis not fit within the display screen Sc (the left and right portions ofthe subject image SI extend off the display screen Sc).

In the first embodiment, Step S9 is performed to cause the wholecircular subject image SI the upper and lower portions of which are cutto be fit within the display screen Sc, and if the diameter DM is largerthan the reference threshold (Yes at Step S9), themagnification/reduction ratio of the subject image SI is set to besmaller than the default value (Step S10). That is, the subject image SIis reduced as compared with the subject image SI in a case in which theimage display part 71 is set in the horizontal arrangement state (StepS12).

The image processing device 92 for an endoscope according to the firstembodiment described above processes the taken image PF including thesubject image SI captured by the inserting part 2 to generate the videosignal, and outputs the video signal to the image display part 71. Theimage display part 71 then displays the observation image OF based onthe video signal. The image display part 71 is configured to be able tobe set in the horizontal arrangement state or the vertical arrangementstate. The image processing device 92 for an endoscope recognizes thesetting state (the horizontal arrangement state or the verticalarrangement state) of the image display part 71, and generates the videosignal so that the subject image SI in the observation image OF has anorientation corresponding to the setting state of the image display part71.

That is, the setting state of the image display part 71 is changed fromthe horizontal arrangement state to the vertical arrangement state, thewidth of the display screen Sc is reduced because the short side Sc1 isalong the horizontal direction, so that the path of flow may be securedfor a person standing in the vicinity of the image display part 71. Evenif the setting state of the image display part 71 is changed from thehorizontal arrangement state to the vertical arrangement state, thesubject image SI in the observation image OF has an orientationcorresponding to the setting state of the image display part 71 (theup-and-down direction of the subject image SI is along the verticaldirection). Thus, after the path of flow is secured for the personstanding in the vicinity of the image display part 71, there is no needto change the setting state of the image display part 71 again from thevertical arrangement state to the horizontal arrangement state.

Accordingly, with the image processing device 92 for an endoscopeaccording to the first embodiment, cumbersome work of moving the settingplace of the image display part 71 is not required, so that conveniencemay be improved.

In the image processing device 92 for an endoscope according to thefirst embodiment, when the diameter DM of the subject image SI in thetaken image PF is equal to or smaller than the reference threshold, themagnification/reduction ratio of the subject image SI in the horizontalarrangement state is the same as the magnification/reduction ratio ofthe subject image SI in the vertical arrangement state.

Accordingly, for example, in a case of observing the subject image SIcaptured by the inserting part 2 configured of an endoscope having asmall diameter, the size of the subject image SI does not have to beunnecessarily reduced when the setting state of the image display part71 is changed from the horizontal arrangement state to the verticalarrangement state, and the subject image SI may be observed in the samesize in both the horizontal arrangement state and the verticalarrangement state.

In the image processing device 92 for an endoscope according to thefirst embodiment, when the diameter DM of the subject image SI in thetaken image PF is larger than the reference threshold, themagnification/reduction ratio of the subject image SI in the verticalarrangement state is smaller than the magnification/reduction ratio ofthe subject image SI in the horizontal arrangement state. That is, onlyin a case in which the setting state of the image display part 71 ischanged from the horizontal arrangement state to the verticalarrangement state, and it is determined that the subject image SI is notfit within the display screen Sc, the size of the subject image SI inthe vertical arrangement state is reduced as compared with the subjectimage SI in the horizontal arrangement state.

Thus, for example, in a case of observing the subject image SI capturedby the inserting part 2 configured of an endoscope having a largediameter, the whole subject image SI may be observed when the settingstate of the image display part 71 is changed from the horizontalarrangement state to the vertical arrangement state.

The image processing device 92 for an endoscope according to the firstembodiment generates the video signal obtained by performingeccentricity correction and position movement correction on the subjectimage SI.

Thus, when the image display part 71 is set in the horizontalarrangement state, the subject image SI is positioned in a center regionof the display screen Sc. On the other hand, when the image display part71 is set in the vertical arrangement state, the subject image SI ispositioned in an upper region of the display screen Sc. Accordingly, theimage display part 71 may display the subject image SI such that it iseasily observed in both the horizontal and the vertical arrangementstates.

Second Embodiment

Next, the following describes a second embodiment of the presentdisclosure.

In the following description, the same component as that in the firstembodiment described above is denoted by the same reference numeral, anddetailed description thereof will not be repeated or is simplified.

FIG. 9 is a block diagram illustrating a configuration of an endoscopedevice 1A according to the second embodiment of the present disclosure.Similarly to FIG. 2 , for convenience of explanation, FIG. 9 does notillustrate the light source device 3, the light guide 4, and the thirdtransmission cable 10.

In the endoscope device 1 according to the first embodiment describedabove, the image processing device 92 for an endoscope is arranged inthe control device 9.

In contrast, in the endoscope device 1A according to the secondembodiment, as illustrated in FIG. 9 , a control device 9A not includingthe image processing device 92 for an endoscope is used in place of thecontrol device 9, and a display device 7A including the image processingdevice 92 for an endoscope mounted thereon is used in place of thedisplay device 7.

As illustrated in FIG. 9 , the control device 9A includes an imageprocessing part 93 in place of the omitted image processing device 92for an endoscope.

The image processing part 93 performs various pieces of image processingon the taken image PF acquired by the image acquisition part 91.Examples of the image processing include known image processing such asgain adjustment, white balance adjustment, gamma correction, and contouremphasis correction. The image processing part 93 then outputs a signalcorresponding to the taken image PF after the image processing to thedisplay device 7A (image processing device 92 for an endoscope) via thesecond transmission cable 8.

The image processing device 92 for an endoscope mounted on the displaydevice 7A performs processing similar to the processing explained in thefirst embodiment (excluding the image processing performed by the imageprocessing part 93 described above) on the signal output from thecontrol device 9A.

Even when the image processing device 92 for an endoscope is arranged inthe display device 7A as described in the second embodiment, the sameeffect as that in the first embodiment described above may be obtained.

OTHER EMBODIMENTS

The modes for carrying out the present disclosure have been describedabove. However, the present disclosure is not limited to the first andthe second embodiments described above.

In the first and the second embodiments, the image processing device 92for an endoscope according to the present disclosure is mounted on thecontrol device 9 or the display device 7A, but the embodiment is notlimited thereto. For example, the image processing device 92 for anendoscope according to the present disclosure may be constituted of amodule separate from the control device and the display device, andarranged in a signal transmission path between the control device andthe display device.

In the first and the second embodiments described above, the insertingpart 2 constituted of a rigid endoscope is used as the endoscopeaccording to the present disclosure, but the embodiment is not limitedthereto. The inserting part 2 may be constituted of a soft endoscope solong as the endoscope includes an eyepiece part.

FIGS. 10A and 10B are diagrams illustrating a modification of the firstand the second embodiments of the present disclosure. Specifically,FIGS. 10A and 10B correspond to FIGS. 7A and 7B, respectively.

In the first and the second embodiments, as illustrated in FIG. 10A orFIG. 10B, various pieces of information (for example, subjectinformation (for example, an ID, a date of birth, and a name),identification information of the inserting part 2 (for example, an IDand an examination corresponding item), and examination content) may bedisplayed in a region BI excluding the subject image SI in theobservation image OF.

FIGS. 11A and 11B are diagrams illustrating a modification of the firstand the second embodiments of the present disclosure. Specifically,FIGS. 11A and 11B correspond to FIGS. 3A and 3B, respectively.

In the first and the second embodiments described above, thesubstantially center position on the back surface of the image displaypart 71 is connected to the pillar 721, and the image display part 71 isconfigured to be rotatable about the substantially center position onthe back surface. However, the embodiment is not limited thereto. Adisplay device 7B illustrated in FIG. 11A or FIG. 11B may be used.

In the display device 7B, one end in a longitudinal direction on theback surface of the image display part 71 is connected to the pillar721, and the image display part 71 is configured to be rotatable aboutthe one end in the longitudinal direction.

With such a configuration, as is clear from comparison between FIGS. 3Band 11B, a large space is created on one side in a horizontal direction(in FIG. 3B and FIG. 11B, the right side) of the image display part 71when the setting state of the image display part 71 is changed from thehorizontal arrangement state to the vertical arrangement state.Accordingly, a path of flow may be sufficiently secured for a personstanding in the vicinity of the image display part 71.

In the first and the second embodiments described above, when thediameter DM of the subject image SI is larger than the referencethreshold, the magnification/reduction ratio of the subject image SI ina case in which the image display part 71 is set in the verticalarrangement state is set to be smaller than the magnification/reductionratio of the subject image SI in a case in which the image display part71 is set in the horizontal arrangement state. However, the embodimentis not limited thereto. For example, a user may set the configuration tobe switchable between the cases in which the magnification/reductionratio of the subject image SI is smaller when the image display part 71is set in the vertical arrangement state than themagnification/reduction ratio of the subject image SI when the imagedisplay part 71 is set in the horizontal arrangement state, and in whichthe magnification/reduction ratio of the subject image SI is the samewhen the image display part 71 is set in the vertical arrangement stateas the magnification/reduction ratio of the subject image SI when theimage display part 71 is set in the horizontal arrangement state.

In the first and the second embodiments described above, change of thesetting state of the image display part 71 from the horizontalarrangement state to the vertical arrangement state may be limited in acase in which the diameter DM of the subject image SI is larger than thereference threshold. In such a case, the image display part 71 may becaused to display a message and the like for prohibiting change of thesetting state from the horizontal arrangement state to the verticalarrangement state.

In the first and the second embodiments described above, rotationcorrection is performed on the subject image SI only when the imagedisplay part 71 is set in the vertical arrangement state, but theembodiment is not limited thereto. For example, a configuration may beemployed for sequentially detecting a rotation angle at the time whenthe setting state of the image display part 71 is changed from thehorizontal arrangement state to the vertical arrangement state, andsequentially performing rotation correction corresponding to therotation angle. With such a configuration, in the observation image OFdisplayed during a period in which the horizontal arrangement state ischanged to the vertical arrangement state, the up-and-down direction ofthe subject image SI is along the vertical direction.

A processing flow is not limited to a processing order in the flowchart(FIG. 6 ) explained in the first and the second embodiments, and may bemodified without contradiction.

An algorithm of the processing explained using a flowchart in thepresent disclosure may be described as a computer program. Such acomputer program may be recorded in a recording part inside a computer,or recorded in a computer-readable recording medium. The computerprogram may be recorded in the recording part or the recording mediumwhen the computer or the recording medium is shipped as a product, ormay be recorded therein by being downloaded via a communication network.

The image processing device for an endoscope according to the presentdisclosure processes the taken image including the subject imagecaptured by the endoscope to generate the video signal, and outputs thevideo signal to the image display part. The image display part displaysthe observation image based on the video signal. The image display partis configured to be able to be set both in the first setting state(hereinafter, referred to as a horizontal arrangement state) in whichthe first side (hereinafter, referred to as a short side) of the displayscreen is along the vertical direction, and in the second setting state(hereinafter, referred to as a vertical arrangement state) in which thesecond side (hereinafter, referred to as a long side) of the displayscreen is along the vertical direction. The image processing device foran endoscope recognizes the setting state (the horizontal arrangementstate or the vertical arrangement state) of the image display part, andgenerates the video signal so that the subject image in the observationimage has an orientation corresponding to the setting state of the imagedisplay part.

That is, when the setting state of the image display part is changedfrom the horizontal arrangement state to the vertical arrangement state,the width of the display screen is reduced because the short sidethereof is along the horizontal direction, so that the path of flow maybe secured for a person standing in the vicinity of the image displaypart. When the setting state of the image display part is changed fromthe horizontal arrangement state to the vertical arrangement state, thesubject image in the observation image has an orientation correspondingto the setting state of the image display part (the up-and-downdirection of the subject image is along the vertical direction). Thus,after the path of flow is secured for the person standing in thevicinity of the image display part, there is no need to change thesetting state of the image display part again from the verticalarrangement state to the horizontal arrangement state.

Accordingly, with the image processing device for an endoscope accordingto the present disclosure, cumbersome work of moving the setting placeof the image display part is not required, so that convenience may beimproved.

The endoscope device according to the present disclosure includes theimage processing device for an endoscope described above, so that theendoscope device according to the present disclosure has the same effectas that of the image processing device for an endoscope described above.The image processing method of the image processing device for anendoscope according to the present disclosure is performed by the imageprocessing device for an endoscope described above, so that the imageprocessing method has the same effect as that of the image processingdevice for an endoscope described above. The image processing programaccording to the present disclosure is executed by the image processingdevice for an endoscope described above, so that the image processingprogram has the same effect as that of the image processing device foran endoscope described above.

It should be understood by those skilled in the art that variousmodifications, combinations, sub-combinations and alterations may occurdepending on design requirements and other factors insofar as they arewithin the scope of the appended claims or the equivalents thereof.

What is claimed is:
 1. An image processor for use with a medical devicethat outputs an image of a subject and an image display that has a firstside shorter than a second side intersecting with the first side, andthe image display having a first setting state in which the first sideis along a vertical direction and a second setting state in which thesecond side is along the vertical direction, the image processorcomprising: circuitry configured to: detect whether a current settingstate of the image display is the first setting state or the secondsetting state; process the image of the subject to generate a videosignal such that the image of the subject to be displayed on the imagedisplay has an orientation corresponding to the current setting state ofthe image display; and output information to be displayed along with theimage of the subject, wherein on condition that the current settingstate is in the first setting state, the circuitry will automaticallycause the information to be displayed at a first position on the imagedisplay relative to the image of the subject on the image display, andon condition that the current setting state is in the second settingstate, the circuitry will automatically cause the information to bedisplayed at a second position on the image display position, relativeto the image of the subject on the image display.
 2. The image processoraccording to claim 1, wherein, in the first setting state, theinformation is displayed in in a first region at the first position anda third region at a third position, different from the first and secondpositions, and, in the second setting state, the information isdisplayed in a second region at the second position.
 3. The imageprocessor according to claim 2, wherein a total area of the first andthird regions is equal to the second region.
 4. The image processoraccording to claim 1, wherein, in the first setting state, theinformation is displayed in in a first region at the first position and,in the second setting state, the information is displayed in a secondregion at the second position, wherein the first region is smaller thanthe second region.
 5. The image processor according to claim 1, wherein,on condition that the current setting state is the first setting state,process the image of the subject to be displayed in a central regionalong a horizontal direction of the image display and the first positionis at least one of a left side of the image of the subject and a rightside of the image of the subject.
 6. The image processor according toclaim 1, wherein, on condition that the current setting state is thesecond setting state, process the image of the subject to be displayedin an upper region or a lower region along a vertical direction of theimage display and the second position is in the lower region or theupper region not occupied by the image of the subject.
 7. An endoscopedevice comprising: an endoscope to be inserted into the subject; acamera for the endoscope that is detachably connected to an eyepiecepart of the endoscope to take the image of the subject, the endoscopeand the camera being the medical device; a controller that controls anoperation of the camera; the image processor according to claim 1; and adisplay being the image display.
 8. The endoscope device according toclaim 7, wherein the image processor is part of the controller.
 9. Theendoscope device according to claim 7, wherein the image processor ispart of the display.
 10. The endoscope device according to claim 7,wherein the image display has a screen size of 40 inches or more.